Serverless Inference for GPU & Sovereign Cloud Providers

Deliver Generative AI (GenAI) models as a service in a scalable, secure, and cost-effective way–and unlock high margins–with Rafay’s turnkey Serverless Inference offering.

Available to Rafay customers and partners as part of the Rafay Platform, Serverless Inference empowers NVIDIA Cloud Partners (NCPs) and GPU Cloud Providers (GPU Clouds) to offer high-performing, Generative AI models as a service, complete with token-based and time-based tracking, via a unified, OpenAI-compatible API. With Serverless Inference, developers can sign up with regional NCPs and GPU Clouds to consume models as a service, allowing them to focus on building AI-powered apps without worrying about managing infrastructure complexities.

Serverless Inference is available AT NOT ADDITIONAL COST to Rafay customers and partners.